Goto

Collaborating Authors

 clean dish


Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation

Zhang, Yihao, Qi, Yuankai, Zheng, Xi

arXiv.org Artificial Intelligence

Foundation models applied in robotics, particularly \textbf{Vision--Language--Action (VLA)} models, hold great promise for achieving general-purpose manipulation. Yet, systematic real-world evaluations and cross-model comparisons remain scarce. This paper reports our \textbf{empirical experiences} from benchmarking four representative VLAs -- \textbf{ACT}, \textbf{OpenVLA--OFT}, \textbf{RDT-1B}, and \boldmath{$π_0$} -- across four manipulation tasks conducted in both simulation and on the \textbf{ALOHA Mobile} platform. We establish a \textbf{standardized evaluation framework} that measures performance along three key dimensions: (1) \textit{accuracy and efficiency} (success rate and time-to-success), (2) \textit{adaptability} across in-distribution, spatial out-of-distribution, and instance-plus-spatial out-of-distribution settings, and (3) \textit{language instruction-following accuracy}. Through this process, we observe that \boldmath{$π_0$} demonstrates superior adaptability in out-of-distribution scenarios, while \textbf{ACT} provides the highest stability in-distribution. Further analysis highlights differences in computational demands, data-scaling behavior, and recurring failure modes such as near-miss grasps, premature releases, and long-horizon state drift. These findings reveal practical trade-offs among VLA model architectures in balancing precision, generalization, and deployment cost, offering actionable insights for selecting and deploying VLAs in real-world robotic manipulation tasks.


Eco-friendly dishwasher uses superheated steam instead of soap to clean dishes

Daily Mail - Science & tech

New dishwasher technology could soon save you money on water, electricity and detergent, a study reveals. Researchers have performed simulations of a dishwasher system that uses superheated steam instead of soap to clean dishes. Superheated steam is an extremely high-temperature vapour generated by heating the saturated steam obtained from boiling water. Results of computer simulations suggest that such a dishwasher would be able to kill 99 per cent of bacteria on one plate in just 25 seconds. As yet, the dishwasher only exists as a computer model, and not a physical object, but researchers say their study provides a basis for the development of next-generation dishwashers'.